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ABSTRACT.  Let  be  complex  constants.  The 

where  (v-’V 

vary  over  all  orthogonal  systems  in  Cn>  is  called  a 
generalized  numerical  range  of  a given  n X n matrix  A. 

In  this  paper  we  study  inclusion  relations  of  the  form 

W('y1>-*.,7  ) c which  hold  uniforni:1^  for  a11 

n-square  matrices  A.  In  particular  we  concentrate  on  the 

case  where  the  coefficients  are  real.  Such  inclusion 

relations  yield  simple  inequalities  among  generalized 

numerical  radii.  Finally,  a further  generalization  of  the 

above  numerical  range  is  discussed. 


1.  Introduction 


Let  A be  an  n x n complex  matrix;  let  c = e Cn  be  a 

fixed  complex  vector,  and  let  be  the  set  of  all  orthonormal  n- tuples 

of  vectors  in  Cn.  In  this  paper  we  study  some  inclusion  relations  between 
generalized  numerical  ranges  which  are  sets  in  the  complex  plane  of  the  form 

WC(A>  * V(yv—,yn)w  • {j*  VAVV  : ' »n}  • » 
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Office  of  Scientific  Research,  Air  Force  Systems  Command,  USAF,  under 
Grant  No.  AF0SR-76-3046.  The  work  of  the  second  author  was  supported  in 
part  by  NSF  Grant  MPS  71-2084. 


0 


-2- 


From  the  definition  it  is  clear  that  Wc(A)  actually  depends  only  on 
the  unordered  set  • • • > 7^  rather  than  on  the  ordered  n- tuple 

c = (7., , • • • ,7n).  In  the  following  the  vector  c will  always  stand  as  a 
representative  of  the  set  an^  we  write  c ~ c’  if  c and 

c represent  the  same  set. 

We  recall  now  the  definition  of  the  k-numerical  range  given  by  Halmos 
[1,  §167],  which  after  a simple  normalization  becomes, 

VA)  = {i  tr(pAF) : P = projection  of  rank  kj,  (1  < k < n)  . 

Evidently  W (A)  may  be  written  as 

K 

(l.la)  Wk(A)  £ (AXj, Xj)  : e Afc| 

where  A is  the  set  of  all  k-tuples  of  orthonormal  vectors  in  Cn.  Hence 

k 

we  see  that 

(1.1b)  Wk(A)  = Wc(A)  with  c = ^(e!  + *•*  + ^ 


{e  )n  being  the  standard  basis  for  C.  Thus,  the  k-numerical  range  is 
J j=l 

a special  case  of  a generalized  numerical  range.  In  particular,  for  k = 1, 
i.e.,  for  c = e^  we  obtain  the  classical  range 

W(A)  = W2(A)  = ((Ax,x)  : |x|  = 1)  . 


It  is  also  clear  that 

VA)  * (s tr  A)  • 

Berger,  [1,  §16.7],  has  shown  that  Wfc(A)  is  convex.  It  was  later 
proven  by  Westwick,  [2],  that  W^(A)  is  convex  for  any  c e B11 . Westwick 
also  gave  an  example  which  shows  that  for  complex  vectors  c e Cn  with 


n > 3,  the  range  WC(A)  may  fail  to  be  convex. 

Certain  inclusion  relations  involving  k-numerical  ranges  were  given 

in  [3].  As  in  [3],  we  are  interested  here  in  inclusions  which  hold  uniformly 

for  all  A € c , that  is  for  all  n x n complex  matrices.  In  this  paper 
nxn 

we  shall  restrict  our  attention  to  elementary  inclusion  relations,  i.e, 
relation  of  the  simple  form 

(1.2)  W (A)  c M .(A),  >>  = constant. 

0 c 

In  a forthcoming  paper  we  shall  consider  inclusion  relations  involving 
finite  linear  combinations  and  integrals  of  generalized  numerical  ranges. 

We  begin  in  Section  2 with  some  definitions.  This  leads,  in  Section  3> 
to  the  construction  of  inclusion  relations  of  type  (1.2)  for  the  general 
case  c,c’  e cn.  Further  results  are  obtained  in  Section  4 for  the  case 
c,c'  e . In  Section  5,  we  derive  some  inequalities  among  generalized 
numerical  radii.  Finally,  in  Section  6,  we  define  a further,  and  in  a certain 
sense  an  ultimate  generalization  of  the  concept  of  numerical  range. 


2,  Partial  order  relations 

We  begin  by  defining  two  partial  order  relations  among  canplex  vectors. 

DEFINITION  1.  (i)  For  c = («y  , •••,7)  and  c'  = (^,•••,7^)  in  c” 
we  say  that  c < c'  if  there  exists  a doubly  stochastic  matrix  S (i.e.,  a 
matrix  with  non-negative  entries  whose  row  and  column  sums  are  1),  such 
that  c = Sc ' . 

(ii)  The  vector  c is  obtained  from  c'  by  pinching  if  two  compo- 
nents of  c’  are  replaced  by  with 


(2.1)  y±  = a 7^  + (1  - a)7j. 


-k. 


Yj  = (l  - a)^  + a'Vj  ; 0 < a < l , 

while  the  other  components  of  c remain  unchanged.  Note  that  pinching  an 
n- tuple  c1  consists  of  moving  two  of  its  components  towards  their  mid- 
point, and  thus  decreasing 

conv( c ’ ) h convex  hull  {7^, • • • , 7^}  . 

A similar  concept  of  pinching  was  used  in  [4]  by  Horn  and  Steinberg. 

(iii)  We  say  that  c « c’  if  c is  obtained  from  c’  by  a succes- 
sion of  a finite  number  of  pinchings. 

Note  that  the  relations  <,  « are  in  fact  relations  between  the 
unordered  n-tuples  •••,7n}  and  (Yp  * * * > • Incase  (i)  it  follows 

from  the  fact  that  doubly  stochastic  matrices  are  closed  under  multiplica- 
tions by  permutation  matrices.  For  case  (iii)  it  follows  directly 

from  the  definition. 

THEOREM  1.  The  relation  c « c’  implies  c < c'  but  not  conversely. 


Proof . If  c « c',  then  assume  for  simplicity  that  c has  been  obtained 
from  c'  by  a single  pinch.  Hence,  for  some  i,j  e (1, ••*,n]  and  a with 
0 < a < 1,  we  have  (2.1).  So  c = Sc',  where  S is  the  doubly  stochastic 
matrix  defined  by 

1 P = q / i,J  , 


s = 
pq 


< 


a 

l - a 
0 


(p»q)  = (i,i),(j,J)  > 
(p>q)  = (i>j)>(j<i)  > 

otherwise  . 


Consequently  c < c'  and  the  first  part  of  the  proof  is  established. 
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Next  consider  the  vectors  c = (l/2,i/2,l/2  + i/2)  and  c'  = (0,1, i). 
Clearly 


/ 1/2 

1/2 

0 

(2.2) 

c=  Sc'  with  S = I 1/2 

0 

1/2 

\o 

1/2 

1/2/ 

so  c < c’.  However  the  components  of  c sire  all  located  on  the 
different  edges  of  conv(c).  Therefore,  any  chain  of  non- trivial  pinches 
on  c'  yields  a vector  c",  where  at  least  two  components  of  c are 
outside  conv(c").  Hence  c / c"  and  the  relation  c <■<  c'  fails  to  hold. 

We  now  wish  to  show  that  ■<  is  a partial  order  relation.  For  this 
purpose  we  need  the  next  lemma  which  seems  of  independent  interest. 

LEMMA.  1.  If  c < c'  and  c’  < c,  then  c ~ c'. 

Proof ; Let  distinct  components  of  c,  ordered  so  that 

loti | > •••  > |aj.  Let  the  multiplicity  of  a£  be  m^  (£  m^  = n),  and 
assume  that  c has  been  arranged  to  take  the  form 

(2.3)  c = (Oj, •••,ak)  . 

In  view  of  the  remark  following  Definition  1,  the  relations  c < c',  c'  < c 
are  still  valid,  hence  there  exist  doubly  stochastic  matrices  S,S'  such 
that 

(2.U)  c c Sc'  and  c'  = S'c  ; 

thus  c = SS'c.  Since  the  class  of  n X n doubly  stochastic  matrices  form 
a multiplicative  semigroup  we  have 
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(2.5) 


c = Tc,  (T  = SS')  , 


where  T is  doubly  stochastic  as  well.  We  assert  that 

(2.6)  T . T1  © ...  © Tk  , 

where  is  doubly  stochastic  of  order  X m£. 

To  prove  (2.6)  assume  for  simplicity  that  k = 2,  i.e., 


c = a2,  ...,a2),  ^ a2,  laj  > |a2l  , 


where  the  multiplicity  of  a ^ (&  = 1,2),  is  m^  and  m^  + = n.  Take 

any  of  the  first  m^  components  of  the  equality  in  (2.5),  say  the  i-th  one. 
Since  la-J  > |c*2l  this  leads  to 


laj  = 


(a  t« h + ( Ji+1  v* 


mi 

<1  £ T 

J=1 


,ij),all  + (^+1  Tij),a?l  5 (jfi  Tij)lai1  = '“l1  ' 


Hence  we  have  equality  which,  in  view  of  the  fact  that  cr^  ^ a2,  may  hold 
if  and  only  if  T^j  = 0 for  J = m^  + 1, ..*,n.  This  means  that  the  first 
rows  of  T vanish  beyond  their  m.^  entries,  so  all  the  weight  of  these 
rows  is  concentrated  in  the  first  m^  columns.  Consequently,  the  first  m^ 
columns  of  T vanish  beyond  their  m^  elements  as  well,  and  we  obtain  the 
desired  decomposition  T = T^  © T2< 

Next  recall  that  doubly  stochastic  matrices  are  convex  combinations  of 
permutation  matrices  Pa  . In  particular  S = £a  CL^a>  thus 


T = SS’  = £ acPaS'  . 
a 

The  matrices  a^P^S'  in  the  above  sum  have  non-negative  entries;  hence  they 
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must  all  have  the  same  block  decomposition  as  T.  Now  we  choose  a 
coefficient  aT  with  ^ 0,  and  conclude  that  P^S1  decomposes 
according  to  (2.6).  Since  P^S1  is  doubly  stochastic  and  it  has  the  same 
decomposition  (2.3)  as  c,  it  follows  that  P^S’c  = c.  So,  finally,  by 
(2.U), 

c1  = S'c  = (P"1)(PTS,c)  = P^c  ~ c , 
and  the  lemma  follows . 

REMARK.  The  above  proof  contains  a special  case  of  the  following  obser- 
vation on  group-rings  over  the  reals  (or  any  ordered  field).  Let 

R(G)  = : a±  e ®,  gi  £ G] 

be  a group-ring  of  G over  ]R , and  let  be  the  convex  hull  of  G 

in  R(G),  that  is 

Kq  = { T : a±  > 0,  Ea.=l]  . 


Then  is  a multiplicative  semigroup  whose  units  are  the  elements  of  G. 

If  H is  a subgroup  of  G,  then  is  a sub- semigroup  of  and  two 

elements  u,v  of  satisfy  uv  c if  and  only  if  there  exists  an 

element  g e G such  that  ug  and  g_1v  are  in  K^.  Thus  the  only  divisors, 
in  K^,  of  elements  of  are  associates  of  elements  of  K^. 

We  conclude  this  section  with  the  following  property  of  < and  « . 


THEOREM  2.  The  relations  ■< 


partial  order  relations  on  the  set 


of  unordered  n-tuples. 
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Proof . We  have  to  show  that  < and  « are  reflexive,  transitive  and 
antisymmetric.  The  first  two  properties  are  easily  verified,  and  by  Theorem  1, 
c <-<  c*  implies  c < c*.  So,  it  suffices  to  prove  the  antisymmetry  of  <, 
i.e.,  that  c < c'  together  with  c'  < c yields  c ~ c'.  But  this  is  the 

I 

statement  of  Lemma  1,  and  the  proof  is  complete. 


3 . Elementary  inclus  ion  relation s_ 

Before  considering  a general  n X n case  we  present  the  following 
result  concerning  2X2  matrices. 

LEMMA.  2.  If  A is  a 2x2  matrix,  then  for  any  a^,  a 2> 

(3-1)  w(a  ,ct2)(A)  = ^al  " a2^  W(A  " |(tr  A)x)  + |(ai  + a2Htr  A1  • 

Thus  W(a  a ^(A)  is  convex. 

Proof.  As  before  let  a2  denote  the  set  of  all  orthonormal  pairs  of 
2-vectors.  If  ,x?  is  in  A2>  then 

(3.2)  O^fAx^x^  + a2(Ax2,x2) 

= - o^)(Ax1,x1)  - ^(ax  - Q2)(Ax2,x2)  + 2(ax  + a2)((Ax1,x1)  + (Ax2,x2)) 

= (a^  - a2)(Ax1,x1)  - - a2)trA  + |(ax  + a2)tr  A 

= (0^  - a2)((A  - |(tr  AjIJx^Xj)  + ^(a1  + a2)tr  A . 

So,  (3.1)  is  obtained  from  (3.2)  as  x^,x2  vary  over  a2« 
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The  convexity  of  W,  n(A)  is  implied  by  the  convexity  of  the 
(classical)  numerical  range  and  the  lemma  follows. 

Using  the  above  lemma  we  obtain  our  first  general  inclusion  relation. 


COROLIARY  1 . If  ( 7^,  ) is  obtained  from  ( 7^,  7)  ) by  pinching,  then 

(3*3)  W(71,72)(A)  C W(7;,72)(A)’  VA  ' C2X2  ' 

Proof.  By  definition  of  pinching  there  exists  an  a,  0 < a < 1,  such  that 
7i  = ori  + (!  - a) 7g,  72  = (1  - a)7i  + ary^  . 

Hence,  by  Lemma  2,  the  two  sets  in  (3-3)  are 

(3-4a)  W(7^7^)(A)  = (7^  _ 7g)  W(B)  + |(7|  + y'2)  [tr  A] 

and 

(3-4b)  W(7l,72)(A)  = (2tt  - l)(7i  - 72)  w(£)  + |(7i  + 72) ttr  A}  , 

where  B = A - -|(tr  A)I  . 

It  is  known  (e.g.,  [I],§l66)  that  the  numerical  range  of  any  2x2 
matrix  is  an  ellipse  (possibly  degenerate)  with  the  eigenvalues  as  foci. 

That  is,  W(B)  is  an  ellipse  centered  at  (l/2)tr  B.  In  our  case  tr  B = 0, 
so  (7^  - 7-pW(B)  is  convex  and  symmetric  with  respect  to  the  origin. 
Therefore,  since  -1  < 2a  - 1 < 1,  we  have 

(2a  - l)(72’  - 72)  w(B)  C (y±  - y£  w(B)  . 

Hence  the  set  in  (3. 4a)  includes  the  set  in  (3.1*b),  and  (3-3)  follows. 

LEMMA  3.  If  c is  obtained  from  c'  by  pinching,  then, 

(3.5)  Wc(A)  c Wc,(A),  VA  e Cnxn  . 
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Proof:  Let  i,j,  i < j,  be  the  pinching  indices  described  in  (2.1). 
Every  fixed  choice  of  n - 2 orthonormal  vectors  in  Cn, 


(3-6) 


xl,“*,Xi-l'  Xi+1’  * * *,xj-l’  xj+l,'",Xn 


determines  a 2-space,  X,  perpendicular  to  these  vectors.  The  values  of 
W (A)  and  W ,(A)  corresponding  to  the  vectors  in  (3.6)  are,  respectively. 


(3-7a) 


n 


and 


(3-7b) 


£ \(AW  + w(7i,Yj)(PA) ' 


\(AVxk>  + W('V’,71)(PA)  • 

,n 


Here  P is  the  projection  of  C on  X,  and  it  is  understood  that 

W,  .(PA)  is  defined  over  X,  i.e., 

(a,p)v  ' ' 

W^a^)(PA.)  = (a(Ax,x)  + p (Ay,y)  : x,y  e X;  x,y  orthonormal}  . 

Since  X is  2-dimensional  and  PA  maps  X.  into  itself,  the  restriction 

of  PA  to  X may  be  presented  by  a 2x2  matrix.  Moreover,  it  is  clear 

from  (2.1)  that  since  c is  a pinch  of  c',  then  (7.  ,*y.)  is  obtained 

* J 

from  (YpYj)  by  the  same  pinching.  Thus,  Corollary  1 implies  that 

w(vV(pa)cH<Wpa)  ' 

Consequently,  the  set  in  (3>7b)  includes  the  set  of  (3.7a).  Since  the 
vectors  in  (3.6)  were  arbitrary,  relation  (3-5)  holds  and  the  proof  is 
complete. 

The  following  theorem  is  an  immediate  consequence  of  Lemma  3. 


1 
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THEOREM  3.  lf_  c « c',  then 

(3-8)  Wc(A)  c Wc,(A),  VA  £ • 

Proof . By  hypothesis,  there  exists  a finite  sequence,  c'  = c^c^, •••,c^  = c, 
such  that  each  c^  (1  < i < i),  is  obtained  from  c^  ^ by  pinching. 

So,  by  Lemma  3, 

Wc(A)  = Wc  (A)  C •••  c Wc  (A)  = Wc,(A),  VA  € , 

SL  1 

and  (3*8)  follows. 

At  this  point  it  would  be  natural  to  ask  whether  c < c'  implies  (3*8) 

or  not.  To  answer  this  question  in  the  negative  take  A = diag  (0,1, i)  and 

c'  = (0,1, i).  Westwick  [2],  has  shown  that  Wc,(A)  includes  the  points  1 
and  2i,  but  not  the  open  line  segment  joining  them.  In  particular 

(1  + 2i)/2  / Wc,.  Now  take  c = (l/2,i/2,l/2  + i/2).  By  (2.2)  we  have  that 

c -<  c ' ; yet  the  point 

^(A  e3,e3)  + Y2(A  + y^A  eg, e^)  = — 

of  W (A)  does  not  belong  to  W ,(A). 
c 

A somewhat  weaker  result  holds  for  the  relation  <,  and  we  establish 
first  the  next  lemma. 

I£MMA  1».  Given  two  bounded  disjoint  convex  sets  X^,  K, , i-n  CD,  then 
there  exists  a linear  functional  cp  on  CD,  such  that  cp(x)  / <p(y)  for 
all  x c xr  y t X2- 

Proof.  We  first  consider  x^,  K.  as  convex  sets  in  B . By  the  Separation 
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Theorem  for  real  vector  spaces  (e.g.,  [5],  Theorem  20,  p.  204),  there  exists 
a linear  real  functional  >|»(x)  on  if*11  , such  that  't'(x)  < \|»(y)  for  all 
x e X^>  y € X 2 • More  explicitly  we  have 

*(x)  = ^11^11  + ^12^12  + ^21^21  + ^22^22  + *"  + ^nl^nl  + ^n2^n2 

where  x = (l^  |j  = 6 x + i|J2,  and  the  are  real  coef- 

ficients. Now  define  a complex  functional  on  Cn: 

<P(x)  = Q1i1  + •••  + pn5n,  pj  = PJX  - iPJ2  • 

It  is  easily  seen  that  \)»(x)  = Re(cp(x));  so  Re(qp(x))  < Re(cp(y))  for 
x e X^>  y e X2>  and  the  lemma  follows. 

THEOREM  4.  We  have  c < c'  if  and  only  if 

(3.9)  Wc(A)  c conv(Wc,(A)},  \/ A e . 


Proof.  If  c < c',  then,  for  some  doubly  stochastic  S,  we  have  c = Sc'. 
The  matrix  S is  a convex  combination  of  permutation  matrices  P^.  Thus 
c = X^.  ctgPg c' , and  the  relation  among  the  components  of  c and  c'  is 

Yj  - *aX(3y  J • 

This  yields  that  any  point  E7  (Ax  ,x  ) of  W (A)  satisfies 

J J J C 

E VAW ' (Axj’xj>  la°yki) 


• So,  E 

o Lj-i 


Mi)(A 
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That  is,  each  point  in  W is  a convex  combination  of  points  in  W , and 

c c 

(3.9)  follows. 

For  the  necessity  part  of  the  proof  we  recall  that  the  condition 
c < c'  is  equivalent  to  the  fact  that  c belongs  to  the  convex  set 


= (Sc'  : S = doubly  stochastic}  . 


Let  136  set  which  consists  only  of  c.  If  c / c',  then 

Kf  H Kg  = and  by  LeD®ia  *+  there  exist  complex  coefficients  • ■ 
such  that  the  linear  functional  <p(x)  = E^  g^£^  satisfies 

(3-10)  <p( c)  i (<p(x):  x e = (cp(Sc’)  : S = doubly  stochastic]  . 

Consider  now  the  matrix  B = diag(g^, • • • ,gn) . We  have 

(3-11) 


n 


n 


On 


<P(c)  = T gjTj  = S 7j(b  eyep  e VB)  • 
the  other  hand  take  any  point  Ej  Yj  (Bxj,Xj}  1°  WC»(B)*  Here 


{x.  = )}n  is  an  orthonormal  system  in  Cn,  so  E.  ||,,|2 

j lj  nj  j=l  ^ 

2 1 1 2 

E..  U.,.,1  =1  an<i  consequently  the  matrix  X,  with  X„  = ||^  | , is 


J ,sij 

doubly  stochastic.  Hence 


n n n 

Z 7’(Bx  ,x  )=  Z y,  E Pillar 
j=l  J J J j=l  J i=l  J 


n n 

= Z B Z X y = <p(  Xc ' ) . 
i=l  1 j=l  J 

This  gives 

W , (B)  c (cp(Sc')  : S = doubly  stochastic]  , 
c 


and  since  the  set  on  the  right  side  is  convex,  we  get  in  fact 
(3-12)  conv  Wc,(B)  c {(J'(Sc')  : S = doubly  stochastic]  . 
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The  inclusion  in  (3.1?)  together  with  (3»H)  yields 

W (B)  i-  conv  W , (B),  and  (3.9)  is  violated. 

0 c 


U , The  cas  e^ jof  r eal  ^coefficients 

For  real  vectors  c the  situation  is  much  simpler.  As  in  the  complex 
case,  the  set  W (A)  remains  unchanged  under  permutations  of  the  7 . 

C J 

Therefore,  given  a set  of  coefficients  £7^, ^ °^en  con_ 

venient  to  arrange  them  in  decreasing  order. 


DEFINITION  2.  A real  vector  c = (7^, ’••,Yn)  is  called  ordered  if 

7i  > 72  > ' • * > 7n  • 

The  convenience  of  ordering  real  vectors  is  demonstrated  in  the  next 
lemma. 

LEMNtt.  5.  If  c'  is  ordered  and  c < c’,  then 

k k 

(U.l)  £ 7,  < E v\>  k = l,...,n  , 

j=l  J j=l  J 

with  equality  for  k = n. 


Proof.  If  c < c*  then  for  some  doubly  stochastic  S, 
Hence  for  a fixed  k,  1 < k < n, 

k k n n / k \ 


(^•2) 


£ 7 i = £ 
i=l  i=l 


£ 

j=l 


E 

j=l 


E S 

L=1 


ijj  y'i 


we  have 


= Sc'. 


Setting 

k 

Qt.«=  E S. J = l, 2,  •••,n 
j i=l 


> 
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we  have 

(M) 


n 


0 < cr  <1  and  E a = k 
~ i ~ J=1  J 


So,  using  the  fact  that  c'  is  ordered,  we  get  from  (4.2),  ( U . 3 ) 

k n k 

E 7i  = S a,y\  < E y\  . 

i=l  J=l  J J J=1  3 

For  k = n each  a.  = 1 and  we  have  equality. 

J 

We  remark  that  the  relations  in  ( h . 1 ) are  discussed  in  Chapter  2 of 
[6],  beginning  with  Section  2.18. 

Two  more  preliminary  result  leads  to  Theorem  5. 


LEMMA.  6.  Let  7^,7^  with  7!^  > 7^  be  two  real  components  of  c\ 
satisfy  0 < 6 < 7^  - 7^.  Then 


Let  5 


esc'-  5(ei  - e^) 


is  a pinch  of  c ' . 


Proof . Denote  a'  = 6/(7^  - 7j).  Evidently  0 < a’  < 1,  and  by  the 
definition  of  c we  have 

(4.4a)  7i  = 7;  - 5 - 7’  - a' (7^  - 7j)  = (1  - a’ )*yj[  + a'7j 

and 

(4.4b)  7j  = 7j  + 6 = 7j  + a’(7i  - 7j)  = a'y[  + (1  - a')Tj  • 

Equations  (4.4)  are  equivalent  to  (2.1),  hence  c is  a pinch  of  c'  and 


the  statement  is  proven. 


I 
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LEMM/V  7.  Let  c,c'  be  ordered.  If  c,c'  satisfy  (4.1)  with  equality 
for  k = n,  then  c « c' . 

Proof.  The  idea  of  the  proof  is  to  construct  a sequence  of  vectors 
c'  = c1>c2,“’>  such  that  each  c^  has  the  following  three  properties. 
First, 


(4.5) 


ci  <-<  ci_i  * i > 2 ; 


second. 


k k 

(4.6)  £ y < £ k = 1,2,  • • .,n  , 

j=l  J J-l  1J 

with  equality  for  k = n;  and  third,  the  number  of  equal  elements  in  the 
sets  and  is  at  least  i - 1.  Here  the  7^ 

and  y^j  are,  respectively,  the  components  of  c and  c^. 

By  the  last  property,  there  exists  a finite  l {l  < n),  for  which 
c = c.  Hence,  by  property  (4.5)  we  get 

jL 

(4.7)  c = c£  « ...  « c1  = c’, 


which  leads  by  transitivity  to  the  desired  result  c « c'. 

As  indicated,  we  start  by  choosing  c^  = c',  for  which  the  first  and 
third  properties  are  satisfied  in  a trivial  manner.  To  show  the  second,  we 
use  the  hypothesis  c < c'  with  Lemma  5>  and  find  that  c and  c^  s c' 
satisfy  (4.6). 

Now  suppose  that  with  the  above  properties  has  been  con- 

structed. If  c^  = c,  then  the  sequence  (4.7)  is  complete;  so  let  us 
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assume  ^ c and  construct  c.^.  We  have  the  inequalities  in  (1.6) 
from  which  we  conclude  that  there  exist  an  r,  1 < r < n,  so  that 

(l.8a)  = ru.— .Yr.i  - Yl;r.!  ; %.  < 7lr  , 

and  a least  s,  r < s < n,  such  that 


(1.8b) 


\ > 'ViS  * 


Since  c is  ordered,  we  have  7 > 7 , which  together  with  (1.8)  gives 

r — s 

Tir  > > 7S  > 7is*  So  tfae  quantity 


(1.9) 


5 = min{7ir-  7r,  7s  - 7is] 


satisfies  0 < 6 < 7 - 7 . Hence,  by  Lemma  6, 


(1.10) 


'i+1 


= - 6(er  - e,) 


is  a pinch  of  c^  So  ci+1  « c i.e.,  c1+1  has  the  first  property  (1.5). 
Next,  we  wish  to  show  that  c^+1  has  the  second  property,  that  is 

k k 

£ Yi  < £ Yi+1  a k = l,...,n  , 

3=1  j=l  1 

with  equality  for  k = n.  Since  c^  satisfies  (1.6),  and  since  ci+^  Is 
obtained  from  c^  by  changing  only  the  r and  s components  while  their 
sum  is  preserved,  it  is  clear  that  for  any  k with  1 < k < r or 
s < k < n,  we  have 

k k k 

j=i  J 3=1  3=1  ■L,J 

Now  use  (1.8)  - (1.10)  to  find  that 


"W  • V - %■ 
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So,  also  for  r < k < s, 

k k k 

^ ^ ^11  — ^ ^i+l  1 

J=1  J j=l  j=l 

Finally,  consider  the  third  property.  According  to  the  construction  of 


ci+1,  we  have  7i+1>r  = 7, 


or  7.  = 7 , or  both.  So,  by  comparing 

r ii x y s s 


with  (4.8)  we  see  that  the  number  of  components  of  c^+1  which  equal 
components  of  c is  greater  than  the  number  of  equalities  for  c^  and  c, 
and  is  therefore  at  least  i.  This  completes  the  proof. 

Combining  Lemmas  5 and  7,  together  with  Theorem  1,  we  easily  obtain 
the  following. 


THEOREM  5 . Let  c,  c'  be  ordered  vectors.  Then  each  of  the  relations 
c < c'  and  c « c*  is  equivalent  to 


k k 

(4.11)  X 7-t  ^ ^ 7-»  > 

j=l  J j=l  J 


with  equality  for  k = n. 

In  general,  it  is  more  convenient  to  verify  condition  (4. 11),  than 
to  check  wnether  c < c'  or  c « c'  according  to  the  original 
definitions . 

Since  the  relations  c < c’  and  c « c'  are  preserved  under 
permutations  of  the  7^,  7j,  we  rephrase  part  of  Theorem  5: 

THEOREM  6.  If  c,  c'  are  real  vectors,  then  the  relations  c < c'  and 
c « c'  are  equivalent. 


We  come  now  to  one  of  the  main  results. 
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THEOREM  7.  If  c,  c'  are  real,  then  c < c'  if  and  only  if 
(4.12)  Wc(A)  cWc,(A),  VAeC^. 

Proof.  By  Theorem  6,  c < c'  implies  c « c' , so  by  Theorem  3 we 
have  (4.12).  Conversely,  (4.12)  yields  (3.9)  and  by  Theorem  4,  c < c' . 

REMARK.  Theorem  7 can  be  obtained  immediately  from  Theorem  4,  using  the 
fact  that  for  real  c,  W£  is  convex,  i.e.,  W£  = conv(Wc].  Yet,  the 
convexity  if  W£  is  not  essential  to  the  proof. 

COROLLARY  2.  (a)  If  c = ( • • • , 7^  «•  with  £ y.  = a,  then 

(a/n, • • • ,a/n)  < c and  hence 

C.13)  {?trA}C  W0(A)>  VAtCnxn- 

(b)  If  7j  > 0,  then  c < (a, 0, •••,())  and 

Wc(A)cOW(A),  VA  e . 

(c)  If  a = 0 then 

(4.14)  D W(A)=(0). 

AeCnxn 

Proof.  First  take  the  ordered  version  of  c and  observe  that  Theorems  5,  7 
yield  (a)  and  (b).  Now,  if  a = 0,  then  according  to  (4.13),  0 c WC(A)  for 
all  A.  Since  wc  (0)  = {0}  we  have  (4.l4)  and  the  corollary  follows. 
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COROLLARY  3-  (Fillmore  and  Williams) . The  k-numorical  ranges  satisfy 
(1-.15)  tr  a]  = Wn(A)  c ...  cW2(A)  cWx(A)  = W(A)  . 


Proof:  By  (1.1),  W_(A)  = W_  (A)  with  the  ordered  vector 

— — — s c 

s 

CS  = (el  + *•'  + es}  • 

' For  all  1 < s < n we  have 

k 1 1 k 

£ %s  = l “Mm}  >T~n  ^{*>s  + !}  = £ yB+i,i  > 

j=i  j"i 

with  equality  for  k = n.  So  Theorem  5 implies  that  cs+^  ■<  cs>  1 < s < n. 
Hence,  by  Theorem  7, 

W . (A)  = W (A)  cW  (A)  = w (A)  ; s = l,---,n  - 1 , 

8 x cs+l  s 

and  we  get  (4.15). 

This  result  was  obtained  in  a different  way,  using  the  convexity  of  Wfc, 
by  Fillmore  and  Williams,  [7]. 


REMARK.  In  general,  for  given  vectors  c = (7^,  •••,7  ),  c'  = (7^,  ••*,7'), 
there  exists  no  constant  A such  that  c < Ac'.  To  demonstrate  this  state- 
ment assume  that  c,c'  are  ordered  and  that  £ y\  > 0,  £ 7.  > 0.  If 

c < Ac',  then  for  some  doubly  stochastic  S we  would  have  c = ASc',  which 


n n 

£ 7,  = A £ 
i=l  i=l 


>1 


Birf 


= A 


n 


yields 
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Cons  equently 

(U.16)  X = £ yt  / £ 7j  > 

so  X > 0,  and  Xc'  is  ordered.  Now,  by  Theorem  5 we  should  get 

k k 

(U.17)  £ 7,  < * r 7l  1 k = 1,  • • • ,n  , 

J=1  J J=1  J 

with  equality  for  k = n.  But  as  X of  (4.l6)  satisfies  ( U . IT ) for  k = n, 

it  will  not,  in  general,  satisfy  the  rest  of  (4.17). 

The  situation  is  quite  different  in  the  homogeneous  case  j;  r - T Y-  = C, 

J J 

where  we  have  the  following  result. 

LEMMA.  8.  Let  c,  c'  be  ordered  vectors  with  £j  7^  = £j  7^  = 0 and  c'  ^ 0. 

Set 

7 + ...  + 7 

(4.18a)  q = q(c,c')  = max  —7  , 

lsk<n  *Vi  + * * • + \ 

y + ...  + 7 

(4.18b)  £ = C(c,c’)  = min  — ; ; . 

l^k<n  ui  + ...  + 7n.k+1 

Then  c < Xc ' if  and  only  if  X > q _or  X < £ . 

Proof . First  we  show  that 

7'  + • • • + 7'  > 0,  7'  + ...  + V , , < 0 ; k = 1,  *..,n-l. 
rl  rk  rn  rn-k+l 

Since  £ 7!  = 0,  it  suffices  to  prove  the  left  inequalities,  so  assume  that 

J 

7'  + •••  + 7'  < 0 for  some  k < n.  This  means  that  7'  , + •••  + V > 0. 

A K ~ 'k+1  rn  — ’ 

thus  7k+1  > 0,  and  consequently  7^  > • • • > 7k  > 7k+1  > 0.  Since  c'  / 0, 
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we  have  y^  > 0 and  our  assumption  is  contradicted.  Similarly,  the  partial 
sums  y + • • • + y , k < n,  are  non-negative,  and  it  follows  that  q,  £ 
of  (4.18)  are  well  defined  and  satisfy  q > 0,  £ < 0. 

Now  choose  A with  A > 0.  The  vector  Ac'  remains  ordered,  and 
according  to  Theorem  5,  c < Ac'  if  and  only  if 


k k 

A E y\  > E y.  i k = 1,  • • *,n  , 
3=1  3 3=1  J 


with  equality  for  k = n.  The  hypothesis  E y.,  = E yl  = 0 

J J 

for  k = n;  so  c < Ac'  is  equivalent  to 

k k 

(4.19)  A E Yl>  S V k = 1,  • • • , n - 1 . 

j=l  J 3=1  J 


implies  equality 


However,  by  the  definition  of  q, 

k k 

t)  E y’>  E y,  , k = 1, -.-,n  - 1 , 

3=1  J 3=1  J 

with  equality  for  some  1 < k < n.  Thus,  (4.19)  holds  if  and  only  if 
A > tj. 

If  A < 0,  then  Ac'  becomes  unordered,  and  its  equivalent  ordered 
version  with  a positive  multiplier  is  (_A)(-y^,  * * *,-y^).  Using  the  previous 
argument,  we  find  that  c < Ac'  if  and  only  if 

y + ...  + y y + ...  + y 

-A  > max  — r- : = -min  — , ■—  = -£  , 

l^k<n  -*Vn  - •••  - 'Yn_jt+i  |<|c<n%i  4 **  1 %i-k+l 


and  the  lemma  follows. 

Theorem  7 and  Lemma  8 have  an  immediate  consequence. 


THEOREM  8.  Let  c,  c’ 


be  ordered  vectors  with 


*)  ^ * 0 


and 


c* / 0.  Then 


WC(A)  c WAc,(A)  _ AWc,(A)  , \/A  e , 

if  and  only  if  A > t}(  c,  e 1 ) or  A < £( c,c ' ) where  t|,  £ are  defined  in 
(it. 18). 


COROLLARY  4.  Let  a = (a^,  •**,a  ) and 
vectors  such  that  not  all  the  components 
a'  = £ otj,  and  define 


a'  = (a^, • • -,a^)  be  ordered 

of  a'  are  equal.  Set  a = £ Of . 

J 


f 


c = a - (a/n,  • • .,a/n) , c'  = a' 


(cc'/n,  • • •ja'/r.)  . 


Then, 

Wa(A)  - (2  tr  ft)  c *(wa,(A)  - {£  tr  a})  , VA  € , 

if  and  only  if  A > ti(c,c')  ^or  A < £(c,c'),  where  t),  £ are  given  in 
(4.18). 


Proof.  The  components  of  the  vectors  c,  c' 
c'  ^ 0.  Hence,  by  Theorem  8. 


satisfy  £ = 0,  and 


Wa(A)  ' {?  tr  A}  = VA)  c XWc’(A)  = *(VA>  " IT  tr  A)  * 


VA  € C 


nxn 


if  and  only  if  the  conditions  of  the  corollary  are  satisfied. 


Generalized  numerical  radius 


A concept  which  directly  relates  to  the  generalized  numerical  range 
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W^(A),  is  the  generalized  numerical  radius 


re(A)  = max  [|z|  : z e Wc(A)} 


= n ax 


{|S 

*■  3-1 


: (v  € An) 


In  particular  we  have  the  k- numerical  radius 


rR(A)  = max  £ |z | : z t Wfe(A)}  , k = 1,2,  -^n  , 


which  reduces,  for  k = 1,  to  the  classical  numerical  radius 


r(A)  = max  [|z|  : z e W(A)}  = max  | (Ax,x)|  . 

1*1*1 

The  function  r(A)  provides  an  important  tool  in  the  linear  stability- 
analysis  of  multidimensional  hyperbolic  and  parabolic  initial  value  problems 
(e.g.,  [8]  §2),  and  one  may  expect  that  the  generalized  radius  will  be 
applicable  as  well. 

It  is  obvious  that  if  Wc(A)  c Wc,(A)  or  even  if  Wc(A)  c:  conv  Wc,( A), 
then  rc(A)  < rci(A),  though  the  converse  nny  fail  to  hold.  Thus,  we  use 
Theorems  U,  8 and  Corollaries  2,3,  to  obtain,  respectively,  the  following 
results . 


THEOREM  9.  (a)  If  c,  c1  are  complex  n-vectors  with  c < c’,  then 


(5.1) 


r (A)  < r .(A),  VA  € C 
cv  ' - c,v  v nxn 


( b ) Let  c , c 1 be  real  ordered  vectors  with  JT  •yn  = I = 0 and 
c ’ / 0 . Let  k satisfy  k>^(c,c')  or  X < £ ( c , c ' ) where  tj,  £ are 
defined  in  (4. If  ) . Then 


r (A)  < |k|  r , (A)  , VA  e C 

cv  ' - ' 1 c,v  ' ’ v nxn 
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(c)  For  c = (7^  •••,7n)  real  with  £.  7j  = a, 


Jsd 


n .trA|<rc(A),  VA  £ 


If  7 > 0,  then 
J 


rc(A)  < a r(A)  , VA  e 


( d)  The  k-numerical  radii  satisfy 

i |tr  A | = rn(A)  < • • • < r^A)  = r(A)  , V A t C 


nxn 


The  numerical  ranges  defined  in  this  paper  can  be  generalized  in  the 
following  way. 


DEFINITION  3.  Let  C e C be  fixed  and  let  u denote  the  group  of 

nxn  n 

nxn  unitary  matrices.  We  call  the  set 


WC(A)  = (tr  (CU*AU)  : Ut^] 

the  C -numerical  range  of  the  n-square  matrix  A. 

If  c = (71»-*,»7n)  is  a given  vector,  we  take  D = diag  (71>',,>7n) 
and  find  that 

(6.1)  Wc(A)  = { ^ 7j^AXj  : (xr...,xn)  € AnJ 


(tr  (DU*AU)  : U f hn}  = W^A)  . 
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So,  indeed,  W£(A)  is  a special  case  of  the  C-numerical  range.  In  fact 
our  last  result  will  characterize  the  class  of  matrices  C for  which 

W ( A)  = W (A)  , VA  £CV  . 

C'  J c ’ nxn 

First,  we  give  two  simple  properties  of  the  C-numerical  range. 

LEMMA  9-  (a)  For  any  C,  A e C ^ we  have 

(6.2)  WC(A)  = WA(C)  . 

( b ) The  set  W^, ( A ) is  invariant  under  unitary  similarities  of  C or 
of  A. 

Proof.  We  have 

WC(A)  = (tr  ( CU*AU ) : U e un]  = (tr  (U*AUC)  : U e 
= (tr  (AUCU* ) : II  t Unj  - WA(C)  , 

so  (6.2)  holds,  and  it  follows  that  C and  A play  a symmetric  role  in 
the  definition  of  WC(A).  Hence,  for  part  (b),  it  suffices  to  show  that 
WC(A)  is  invariant  under  unitary  similarities  of  A.  But  that  is  an 
immediate  consequence  of  Definition  3 which  states  that  WC(A)  depends  only 
on  the  class,  8(A)  = (U*AU  : U t Un}>  of  matrices  unitarily  similar  to  A. 
The  next  result  leads  to  Theorem  10. 

LEMMA  10.  _If  3,  8'  are  compact  connected  subsets  of  CnNn  so  that 


(6.3) 


(<p(X)  : X t 8}  = (<P(X')  : X'  e 8'} 
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for  all  linear  functionals  <p  on  C , then 
— T — nxn 

X = conv{8}  = conv{8'}  = K'  . 


Proof.  We  recall  that  the  hyperplanes  (of  real  dimension  2n  - 1)  of 

C „ are  the  loci  of  the  equations 
nxn 

Re  (<J>(X))  = a 

as  p varies  over  the  nonzero  functionals  in  C*  and  a varies  in  ]R. 

nxn 

Since  8 is  connected,  a hyperplane  intersects  g if  and  only  if  it  intersects 
conv  {g}  ; thus  (6.3)  implies 


(6.U)  (Re  (p(X))  : X c X]  = {Re  (p(X’))  : X'  c X'}  , V P e C 


nxn 


Now  choose  a functional  p and  consider  the  set  of  real  values 


ftq/K)  = {Re  (<p(X))  : X e X}  . 

Since  X is  compact  and  connected,  ft  (x)  is  a closed  interval  with  end  points 

* “in  R^X)  , = max  ft  (x)  • 

This  means  that  a hyperplane  Re  (p(X))  = a intersects  X if  and  only 
if  a e R^(x)»  and  in  particular 


(6.5) 


Re  (p(X))  = M-!  , Re  (p(X))  = ^ , 


are  the  two  planes  of  support  for  x defined  by  p. 
According  to  (6.U) 


e Cnxn  ; 


(6.6) 


VK)  =VK,) 


; 
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eo  the  hyperplanes  in  (6.5)  support  X*  as  well  as  K,  for  all  qp.  Since 
convex  sets  are  uniquely  determined  by  their  supporting  planes,  the  proof 
is  complete. 

THEOREM  10 . We  have 

(6.7)  WC(A)  = WC,(A)  , VA  e , 
if  and  only  if  C,  C'  are  unitarily  similar. 

Proof.  If  C,  C1  are  unitarily  similar,  then  (6.7)  is  given  by  part  (b) 
of  Lemma  9 . 

For  the  converse  we  use  (a)  of  Lemma  9 by  which  the  hypothesis  in  (6.7) 
becomes  WA(C)  = WA(C')  for  all  A;  or  more  explicitly 

(6.8)  (tr  (AU*CU)  : U e Ujj}  = (tr  (AU*C'U)  : U e 1^]  , V A c . 

Next  we  remember  that  every  linear  functional  cp  on  f°rm 

n n 

<p(X)  = T £ a,  ,1 = tr  (iiX)  , 
i=l  j-1 

where  A = [a^ ] is  a matrix  of  coefficients,  and  X = [ ] is  arbitrary. 
Thus,  the  hypothesis  in  (6.8)  takes  the  form 

(<?>(X)  : X £ S}  = [qp(X')  : X’  e g'J  , i 

where 

g = (U*CU  : U e un]  , S'  = tU*C'U  : U t Ujj} 
are  compact  connected  subsets  of  Consequently,  by  Lemma  10, 
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(6.9)  X = conv{s}  = conv{S'}  = K'  . 

The  sets  K,  X'  are  compact,  so  they  are  spanned  by  the  extreme  points  of 
8 and  S',  respectively.  Therefore,  by  the  equality  in  (6.9)  we  finally 
get 

ext[s]  = ext {S'}  . 

Now  take  a point  U^CU^  in  ext{S} . It  equals  a point  U|C'U2  in 
ext  {S'}  where  U^,  are  both  unitary.  That  is, 

C = U*C'U  with  U = U2U*  , 

and  the  theorem  is  proven. 

Our  last  result  characterizes  the  relation  between  the  C-numerical  and 
the  c-numerical  ranges. 

COROLLARY  5*  For  a given  C e C_w„  , there  exists  a vector  c e cn 
such  that 

(6.10)  WC(A)  = Wc(A)  , VA  e , 

if  and  only  if  C is  normal.  If  C is  normal,  then  the  components  of  c 
are  the  eigenvalues  of  C in  an  arbitrary  order. 

Proof • By  (6.1),  the  equality  in  (6.10)  is  equivalent  to  having  a diagonal 
D = diag  (7^>--*,Yn)  such  that 

WC(A)  . Wd(A)  , VA  <.  . 

But  C is  unitarily  similar  to  a diagonal  matrix,  if  and  only  if  C is 
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normal,  so  Theorem  10  completes  the  proof. 

Note  that  if  C is  normal  with  real  eigenvalues  — that  is 
Hermitian  — then  (6.10)  holds  with  a real  c,  and  by  Westwick's  Theorem 
W^(A)  is  convex. 

We  conclude  this  paper  with  the  following  discussion. 

REN&RK.  It  is  clear  now  that  W^(A)  is  the  range  of  values  of  the  mapping 

<p  : 8(A)  C 

where 


8(A)  = {U*AU  : U e Un]  c , 

and  <p  is  the  linear  functional  on  C_v_  defined  by 

nxn 

qp(X)  = tr  (CX)  . 

That  is,  W,(A)  gives  us  all  the  information  a single  functional  can  provide 
about  the  set  8(A).  From  this  point  of  view,  Wp(A)  is  an  ultimate 
generalization  of  previous  concepts  of  numerical  ranges. 

However,  more  information  on  g(A)  could  be  obtained  by  considering 
mappings  of  the  form 

X - (cp^X),---,^))  € Cm  , (X  e 8(A))  , 

where  ©.,•••,©  are  functionals  on  C . and  m is  arbitrary.  In  fact 
Tx  nxn 

2 

we  do  not  need  m > n ; for  if  we  denote  by  the  functional  defined  by 

<Pij(X)  = Xij  £ f ij  ’ 
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then  the  mapping 


X - (cpn(X), 


VP^X))  = (I 


11’ 


i ) € C 


n 


Jnn 


exactly  characterizes  the  set  S(A)- 
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